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Abstract 

This paper investigates the probabilistic properties that determine 
the existence of space-time transformations between diffusion processes. 

We prove that two diffusions are related by a monotone space-time 
transformation if and only if they share the same serial dependence. 

The serial dependence of a diffusion process is studied by means of its 
copula density and the effect of monotone and non-monotone space- 
time transformations on the copula density is discussed. This provides 
us a methodology to build diffusion models by freely combining pre¬ 
scribed marginal behaviors and temporal dependence structures. Ex¬ 
plicit expressions of copula densities are provided for tractable models. 

A possible application in neuroscience is sketched as a proof of concept. 

1 Introduction 

Monotone space-time transformations (STTs) have been shown to map dif¬ 
fusion processes into diffusion processes by Kolmogorov j28] as early as 1931. 
Closed form expressions for the transition probability density function (pdf) 
are known in a limited number of cases, including the Wiener and the Cox- 
Ingersol-Ross (CIR) processes. The class of tractable models is remarkably 
enlarged considering STTs, since the transition pdfs of two diffusion pro¬ 
cesses related by an STT can be calculated from one another. Necessary 
and sufficient conditions for the existence of STTs conserving the probabil¬ 
ity mass and mapping a diffusion process into a Wiener or a CIR process are 
known [niEHiiio]. Such conditions prescribe relationships between the drift 
and the diffusion coefficients that do not have a probabilistic interpretation. 
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Ti’ansformations not conserving the probability mass have been studied in 
13 HQ], but they are beyond the aim of this paper. 

Recently Kozlov [5^] has given new insights on transformability of dif¬ 
fusions by STTs, proving that if an SDE admits a 3-dimensional symmetry 
algebra then the process can be transformed into a Brownian Motion. If 
there are only 2 symmetry generators, then the process is transformable 
into a CIR process. There is no general model for the 1- and 0-dimensional 
cases. This new classification explains the special role of the Brownian Mo¬ 
tion and the CIR processes among diffusions and why their Kolmogorov 
equations are easier to solve, but still it does not clarify which is the com¬ 
mon probabilistic structure that singles out the class of processes that can 
be transformed by an STT into one of the two mentioned models. The first 
aim of this paper is to investigate the probabilistic ground that determines 
such transformability properties. 

Our second goal concerns modeling. Many diffusion models of natu¬ 
ral phenomena are formulated by considering a stationary diffusion process 
with an assigned marginal distribution (fitted from data or postulated a- 
priori) and specifying additional constraints on the dependence structure of 
the process. The authors of [7] match the stationary distribution and the 
empirical autocovariance. In [8] an ad-hoc special form for the infinitesimal 
variance coefficient is proposed. Furthermore in [miMi an STT is applied to 
an Ornstein-Uhlenbeck process in order to change its marginal distribution 
into other specific (e.g. bivariate or heavy tailed) ones. We investigate here 
the possibility to make this approach more general and systematic with a 
method that enables to specify the marginal behavior and the serial depen¬ 
dence of the diffusion separately. 

To characterize the serial dependence of diffusions we use copulae. Cop- 
ulae have become a very common tool for modeling dependence in applied 
probability and statistics (cf. [22l |25l IMl)- They have found applica¬ 
tion in many different fields ranging from finance and insurance [la ES], 
to reliability mm, stochastic ordering [36], geophysics |l2], neuroscience 
ISElEniEHlESlllI], statistics |19) and many more. 

For every Markov process X{-) there exists a copula joining the random 
variables X(s) and X(t) that verifies the Chapman-Kolmogorov equation 
mi. Lageras |30j underlines some limitations in the applicability of the 
classical families of copulae in the framework of stochastic processes show¬ 
ing, for example, that Frechet copulae imply innatural Markov processes 
while Archimedean copulae are incompatible with the dependence of Markov 
chains. Other objections to the use of copulae can be found in |32| and in 
the related discussions. According to |32| “copulas do not really fit into the 
theory of stochastic processes and time series analysis”. This argument is 
certainly true to some extent (cf. also |30|) but it seems to us too assertive. 
In this paper we discuss instances in which copulae are helpful tools when 
modeling with diffusion processes. 
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The properties of copulae of diffusions are illustrated in Section H by 
means of the so called uniformized diffusion process. In Section we prove 
that two diffusions can be transformed into one other via monotone STTs 
if and only if they share the same copula, up to a time stretching. Non¬ 
monotone transformations are also considered and their effect on the cop¬ 
ula density is investigated. The new understanding of monotone STTs as 
mappings which preserve the copula enables modeling applications that are 
discussed in Section together with a set of examples. With the aim of 
going beyond the objection of m, here we propose to use specific families 
of copulae selected from the tractable Wiener and CIR processes and by 
other diffusions related to them by STTs. 

2 Mathematical background and notations 

2.1 Copulae 

Consider a pair of real-valued random variables (r.v.s) X and Y taking val¬ 
ues in RanX = [lx,rx], RanT = [Zy,ry], respectively, where Ran is the 
range operator for functions. Let Fx,y {x, y) = P {X < x,Y < y) he their 
joint distribution. Fx,y encodes all the probabilistic properties of X and 
Y in the same object: the marginal distributions of X and Y, as well as 
any information on the dependence between the two r.v.s. (e.g. correlations 
of any order). However there are instances in which it is desirable to dis¬ 
tinguish between marginal and joint properties of {X,Y). Copulae are the 
appropriate tool to decouple the dependence properties of two r.v.s from 
their marginal behavior. In this section we mention definitions and proper¬ 
ties of copula functions that will be used thereafter, referring to ([S]) for 
the proofs and for other facts in copula theory. In this paper we consider 
Markov processes only, where the properties of the process at any time t 
conditioned on the state of the process at a time s < t are independent of 
the state at any time r < s. Thus, bivariate copulae are enough to charac¬ 
terize the temporal dependencies. For this reason we do not introduce the 
multivariate setup and in the remainder refer to bivariate copulae simply as 
copulae. 

Definition 2.1. A copula is any function C : [0,1] x [0,1] — )• [0,1] such 
that: 


• V u,v £ [0,1], C satisfies the boundary conditions 

C{u,0) = 0, C(0,u) = 0 C{u,l) = u C{l,v) = v 

• C is 2-increasing, i.e. V n, v, u', v' £ [0,1] such that u < u' ,v < v' : 

Vc ([ri, u'] X [u, u ']) := C (u, u') — C {u', v) — C {u, v') + C {u, v) > 0. 
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Remark 2.1. Note that any copula is, by definition, a joint distribution over 
the unit square. 

Theorem 2.1 (Sklar). LetFxy, Fx, Fy be the distributions defined above. 
Then there exists a copula C sueh that for all {x,y) G [Ix^rx] x [/Y,ry], 

Fx,Y{x,y) = C{Fxix),FY{y)). (1) 


If Fx and Fy are continuous, C is unique; otherwise it is uniquely deter¬ 
mined on Ran Fx x Ran Fy ■ Conversely, if C is a copula and Fx , Fy 
are distribution functions, then the function Fx,y defined by 0 is a joint 
distribution function with margins Fx and Fy. 

Thus a copula is a function that combines, or “couples”, two margins to 
return a joint distribution. 

Definition 2.2. The r.v.s U = Fx (X) and V = Fy (Y) are called uni- 
formized r.v.s associated to X and Y , respectively. 

Definition 2.3. The density of a copula C is the function c defined by: 


c (u, v) 


d^C(u,v) 
dudv ’ 


if the derivative exists. 


( 2 ) 


Copula densities are probability density functions over the unit square. 

Theorem 2.2. Let cx,y iu,v) be a copula density between the r.v.s X and 
Y, and let a(-) and /5(-) be .strictly monotone functions on RanX andHanY 
respectively. Then 

Ca(X),y(Y) {u, v) = Cx,Y {u, v) . 

Ifa{-) and f3{-) are strictly increasing then also Ca{x),g{Y) {u, v) = Cx,y {u, v). 


Remark 2.2. If X and Y are continuous, Fx and Fy are strictly increasing. 
Thus, by virtue of Theorem 2.2 the copula of {X,Y) is also the copula 
of {U,V). It represents also the joint distribution of {U,V), because the 
margins are uniform on the unit interval. 

The following result connects copulae and conditional probabilities (cf. 

my- 

Theorem 2.3. Let Xi, f = 1,2, be two r.v.s with margins Fi. Then 


diC {Fi{xi) ,F2 {x2)) = P {Xj <Xj\Xi = Xi), i,j = 1,2, i^j (3) 

where di, i = 1,2, denotes the partial derivative with respect to the i-th 
argument. 
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The derivatives of a copula with respect to one of the arguments, when 
existing, are bivariate conditional distributions over the unit square. When 
coupling r.v.s uniformly distributed in the unit interval, the derivatives also 
represent the conditional distribution function of one r.v. with respect to 
the other. 

2.2 Diffusion processes 

Let {W}tg[ 4|3 Tj) ^ dimensional diffusion process taking values in the 
interval I = {l,r) with —oo <l<r< +oo. Its sample paths are solution of 
the SDE 

dXt = n{Xt,t)dt + a{Xt,t)dWt , . 

Xto = xo ^ ’ 

for any Iq <t < Tj. Here Tj is the first exit time from I and Wt = {ILtloio 
is a standard Wiener process. We assume classical conditions (cf. |21j l on 
the drift /r (x, t) and the diffusion coefficient a (x, t) > 0 to ensure existence 
and unicity of the solution. 

Let 


Ft\s ix\y) ■■= P{Xt < x\Xs = y) 
be the transition distribution of X and let 


ft\s {x\y) 


dFt\s {x\y) 
dx 


s < t, 


(5) 


be the corresponding transition pdf. Whenever it does not generate con¬ 
fusion, we drop the initial conditions from the notation of the marginal 
distributions, denoting them by Ft (x) instead of Ft\tg{x\xo). 

When the boundaries l,r of I are natural, according to Feller’s classifi¬ 
cation (cf. [22]), the function ([^ is the unique solution of the Kolmogorov 
backward equation 


dp 


/ X dp 

+ My.s}-^ + 


cr^ {y, s) d‘^p 
2 


= 0 


( 6 ) 


with the final condition 


limp {x,t\y,s) = 5{x — y). 

s^t 


(7) 


Here 6 {■) indicates the Dirac delta. Furthermore, the transition distribution 
Ft\s {x\y) is the unique solution of Q when Q is replaced with 

lim-T’tls {x\y) = l[o,oo) {x-y), 

where l[o,oo)(') denotes the Heaviside step function, i.e. the indicator func- 
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tion of the positive half-line. 

The transition pdf / also solves the Fokker Planck equation 

^ + g^|f,(x,t)p|--^P(x,f)p]=0. (8) 

When both boundaries are natural the solution corresponding to the initial 
condition 

limp {x,t\s,y) = 6 {x — y). 

t^S 

is unique. Otherwise further boundary conditions should be added to guar¬ 
antee the uniqueness of the solution of Q or Q. 

2.2.1 Copulae for diffusion processes 

For fixed times t > s > Iq, Xg and Xt are continuous r.v.s. We are interested 
in investigating the structure of their dependence using copulae. Copulae 
of Markov processes have been extensively studied in |14j . Here we focus 
on the special case when the Markov process is a diffusion. We denote by 
Fs,t{x,y) = P {Xg <x,Xt< y) the joint distribution of Xg and X^. The 
copula between Xg and Xt evaluated in (u, v) £ [0,1] x [0,1] is 

Cg,t{u,v) = Fg,t[F^\u),Ff\v)] 

the associated copula density is 

, fg,t{Fg-Hu),Fr\v)) ft\g {Fi\v)\F-^{u)) 

^ fsiFs-\u))MFi\v)) ft{Fi\v)) ’ 

and 

Cg^t{w, z) dw dz. 

3 Uniformized diffusion processes 

In the context of diffusion processes, the serial dependence of the observa¬ 
tions is much more commonly investigated in terms of transition distribution 
than in terms of joint distributions. The parallel concepts in the language 
of copulae are introduced below. 

Definition 3.1. We call uniformized transition distribution of a diffusion 
process {Xt}^^^^ between times s and t, to < s < t, the function 

C„Mu) £ 


pv 

Cg^t{u,v) = / Cg^t{u,z)dz. (9) 

Jo 


Cg^t{u,v) = 


rv pi 

Jo Jo 
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The uniformized transition distribution of a diffusion process retains all 
the information about the serial dependence carried by the transition distri¬ 
bution of X irrespective of its marginal properties. Due to Theorem 2.3 the 
uniformized transition distribution is a distribution function with respect 
to the variable v having support on [0,1], i.e. a transition distribution. To 
give a clearer understanding of its meaning we introduce the concept of 
uniformized process. 


Definition 3.2. Given a diffusion process for any choice of an ini¬ 

tial time ti > to we define uniformized process associated to X the stochastic 

process \ Xt\ given by 
I J t>t^ 


Xt Ft{Xt) Vt > > to- 

Remark 3.1. The initial time ti for Xt is set to any time that strictly follows 
the initial time to of X because for any t > to the marginal distribution 
Ft{Xt) is continuos. Note that this is not the case for t = to, when the 
probability mass is concentrated at xo, and that would make the trajectories 
of Xt discontinuous at to- X is initialized at random with a continuous 
initial density supported in J C / the extension Xt to to becomes immediate. 

The uniformized process X associated to X takes values in [0,1] and has 
uniform marginal distribution at each time. The joint probability distribu¬ 
tion of two observations ( Xg, Xt ) with s,t > ti is 


Fg^tiu, v) = P (^Xg <u,Xt < v'^ 

= FgffF-\u),Fr\v)] 


P{Xg<F-\u),Xt<Fff\v)) 

Cgffu,v) 


and it coincides with the copula of {Xs,Xt). By Theorem 2.3, the associated 
transition probability distribution is given by 


Ft\g{v\u) = P < u\Xt = 


P {Xg < F;\u)\Xt = Fff\v)) = Ct\g{v\u) 

( 10 ) 


for any u,v £ [0,1] and any t > s > ti > to- Moreover, since at any given 
time the uniformized process is obtained by a strictly increasing transforma¬ 
tion of X, in light of Theorem 2.2 it retains the same copula function of the 
process X. To conclude, X and X share the same copula function which is 
also the joint distribution of X. 


Theorem 3.1. The transition pdf ft\siTW) of the uniformized process X 
coincides with the joint copula density Cgffu,v) of the process, i.e. 


ft\siv\u) = Cgffu,v) 


ft\g {F,-\v)\Fiffu)) 

ft{Ft-Hv)y 


( 11 ) 
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for any u,v ^ [0,1] and any t > s > ti > Iq. 


Proof. By definition ft\s{v\u) = and by equation (10) and equa¬ 
tion ([^, the thesis follows. □ 

Theorem 3.2. Let equation @ admit a unique solution having 

diffusion interval I = (/,r). The uniformized process s associated 

^ I J t>tl 

to is an ltd diffusion process, initialized at X (ti) = Ft^ with 

a uniform distribution. Its drift Jl and diffusion coefficient a are given by 


h{u,s) = 


x=Fs ^(u) 


+ m(-^s ^ (u), s) fs [F, 1 (u)) -h 


+ 3^^ ^ («) >'S) fs {Fs ^ («)) > 

a{u, s) = a {Ff^ (u), s) fs {Ff^ {u) , s) , 

1, ft f \ dfs(x) d'^Fsix) 

where /' (x) = 

Proof. For any t > ti > to Ito’s formula yields 


( 12 ) 


dFt (Xt) = 


+ T {Xt,t) ft (Xt) + (Xt, t) f (Xt) 


where f {Xt,t) = ^ 
equality gives the thesis. 


x=Xt 


dtp 

+ a(Xt,t)ft(Xt)dWt 
Substituting Ff^ ™ 

□ 


Remark 3.2. Diffusion processes sharing the same uniformized process con- 
stituite a class characterized by a unique transition copula. 

Theorem 3.3. Let {Xt}^y^^ be a time-homogeneous diffusion process, hav¬ 
ing drift fJ.(x), diffusion coefficient (t(x) and diffusion interval I = {l,r) 
where r and I are natural boundaries. Let Ft (x) be its marginal distribu¬ 
tion. The uniformized transition distribution Ct\s(v\u), fort > s > to, is the 
unique solution of the Kolmogorov backward equation 

Y^Ct\s(v\u) + p {Ff^ (u)) -^Ctis (u |u) + (Ff^ (u)) -^Ctisivlu) = 0, 


du 


du^ 


where p, and a are given by (12), with the final condition 
limCti,. (v\u) = l[o,oo) (v-u). 


(13) 

(14) 
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Proof. Let us first consider the final condition. We can rewrite its left hand 
side as 


limC's,t {u;v) 

Note that the last equality holds because the derivative is performed with 
respect to u and the limit operates on s. Furthermore, 



d 

limCiis {v\u) = lim -7^Cs,t {u-,v) = 

sfi st* OU 


A 

du 


lim C {u, s; v, t) 


limFx,y {F, ^ (u)) 

Fs (min (F“^ (u), (u))) 

Fs {F-^ (min {u, v))) = min (n, v). 


Note that the transformation Ft maps the boundary points ll and r for X 
into the boundary points 0 and 1 for X, repsectively. Ft is increasing and 
therefore does not alter the nature of the boundaries, which are natural for 
X if and only if they are natural for X. 

As far as the Kolmogorov backward equation is concerned we note that 
Eq. (13) follows from equation (2.3) and Theorem 3.2 Indeed, Equation 


(10) ensures that C^g{u\v) is the transition distribution of the uniformized 
process. Theorem |3.2| guarantees that the uniformized process is an Ito 
diffusion, and provides its infinitesimal coefficients. Hence its transition 
distribution must be solution of the Kolmogorov backward equation having 
the same infinitesimal coefficients. □ 


Remark 3.3 {Reflecting boundaries). In Theorem 3.3 we assumed that the 
boundaries I, r are natural. However, the uniformized transition distribution 
Ct\s{v\u) is still the unique solution of the Kolmogorov backward equation 
(13) with final condition (14) and reflection condition |^Ct|,(u|u)U=o,i = 0 
if one or both the boundaries are regular and the transition distribution 
Ft\s{y\x) fulfills a reflection condition -§^Ft\s{y\x)\x^t^r,i} = 0 at the regu¬ 
lar boundary. Indeed can be calculated directly, and by © 

and (10) it is easy to prove that g(^C't|s(u|n)|„g{o,i} = 0 if and only if 
gy-^t|s(y|^)Ug{r,q 0. 


Remark 3.4. The transformation Ftf) used to transform X into X depends 
on xo and to- Hence the drift and diffusion coefficient of X depend on xq and 
to as well. This might be misleadingly interpreted as an indication that the 
Markov property does not hold for X. However xo and to are parameters 
of Ftf): changing either xo or to affects both the initial conditions and the 
transformation. As a consequence, for each xq and to we get a different uni¬ 
formized process X, characterized by its diffusion equations. Each process 
that can be obtained from X through Ftf) verifies the Markov property. 
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Equations (12) reveal that generally the uniformized process is not time 
homogeneous, even if such is the original process. The following result en¬ 
sures that in the stationary regime the uniformized process becomes time 
homogeneous again. 


corollary 3.4. Let be a time homogeneous process, admitting steady 

state density g{x) and steady state distribution G{x). Asympotitcally, when 
the distribution of Xt coincides with G{x), the uniformized process Xt, t > s, 
is a time-homogeneous diffusion process, having infinitesimal coefficients 


h{u, s) = n{u) = /i (G ^ (u)) g {G ^ (u)) -h {G ^ (u)) g' {G ^ (u)) , 

a{u, s) = a{u) = a (G“^ (u)) g (G“^ {u)) , 

(15) 


where g'{z) := dg{z)/dz. 


Proof. The proof is analogous to that of Theorem 3.2 


□ 


Corollary |3.4| ensures that the coefficients of the uniformized processes 
associated to stationary diffusions admit (finite) limits for t —)• oo. 


4 Copulae and space-time transformations 


Already in 1931, Kolmogorov |28) has shown that monotone STTs of the 
type 


y = 

T = (p{t), 


(16) 


with Jacobian J{t,x) = > 0 for every x £ I and ip{t) non-decreasing, 

map diffusion processes into diffusion processes (the case J(t,x) < 0 is 
analogous). It is also well known (cf [9]) that the only transformations 
mapping the Kolmogorov backward equation of a diffusion process into the 
Kolmogorov backward equation of a different diffusion process have the same 
structure of (16). If an invertible transformation relates the two diffusion 
processes Xt and K^(t) = ifit, Xt) and the transition pdf of Xt is known, the 
one of Yr can be expressed (as long as probability mass is conserved) by 


fr\roiy\yo) 


J{t, x) 


(17) 


In [38] and [l0| necessary and sufficient conditions for the existence of 
such transformations are given when Xt is a Wiener or a Cox-Ingersoll-Ross, 
respectively. These conditions require the drift and diffucion coefficient of 
the original process to verify an equation that has no immediate probabilistic 
interpretation and hides the reasons why some processes can be transformed 
into others and some cannot. As already mentioned in Section one of 
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the goals of the paper is to provide a direct probabilistic interpretation 
of transformability between diffusion processes. The following Theorems 


4.1 and 4.2 accomplish this task by establishing the mathematical relation 
between copulae and STTs. 

Theorem 4.1. A diffusion process X can he transformed into a diffusion 


process Y via a monotone STT (16) if and only if they share the same copula 


density up to the time transformation, i.e. 

Cs,tiu,v) = 

for any to < s < t and u,v G [0,1]. 


(18) 


Proof. If a monotone transformation maps X into Y, Theorem 2.2 implies 


(18). On the other hand, if (18) holds then the two uniformized processes 
Xt = F^{Xt) and T^(t) = (Yt) have the same transition pdf and applying 


^ yields a process obeying the same law as Y^(^fy 

Hence, the monotone STT 


y = 


Pm 


1 - 1 , 


{F,^ix)) 


T = ip{t), 


maps Xt into 1^. 


□ 


Theorem |4.1| highlights that monotone STTs only affect the marginal 
distributions of a process while preserving the copula (saved for the stretch¬ 
ing of the time axis). Two processes that can be mapped into each other 
by a monotone STT share the same dependence structure up to the time 
stretching. 


Remark 4.1. The explicit expression of the copula density of a diffusion 
process whose transition is known and that can be mapped into a simpler 
diffusion by a monotone STT can be derived either using equation 0 or 
applying Theorem |4.1[ The latter approach is sometimes advantageous as 


we shall see explicitly in Remark 5.1 and Remark 5.2 


In many occasions it is of interest to consider more general transforma¬ 
tions than (16). In particular, relaxing the monotonicity assumptions of 
V’(t, •) by piecewise monotonicity determines losing the invertibility of the 
transformations and also the possibility of applying Theorem 2.2 directly, 
but broadens the class of processes that can be taken into account. Inter¬ 
esting examples are shown in Section 


Theorem 4.2. Let X be a diffusion process with known transition pdf and 
initial conditions. Let also tp : x J —)> M 6e an STT as in (16) such that, 
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for every t, Jt{x) = exists and is not vanishing except for at most a 

countable number or points of the diffusion interval I. Under the assumption 
of conservation of the probability mass, the diffusion := if{t,Xt) admits 
for any to < s < t eopula density funetion 


= E 


w \ s,z. 


(v) 

where 




Y 

^{s) 


1 -1 


(n) U; t,x, 




Y 

ip(t) 


1 -1 


(19) 

(^^)) cf^t{Ff{z),F^^{x)), 


w{s,z,q) := 


ffjz) 

\Mz)\ 


(q) 


( 20 ) 


a:'ip{s^a)=q 


Proof. Let us start by deriving the transformation formula for the transition 
pdf under the hypothesis of conservation of the total probability mass. 


E 


f^(x\ y) 


fY /IN _ 

U{t)Ms)Ky\Q) - 


x: 'ip{t,x)=y 
z-.i){s,z)=q 


f^tiz,x) 

\Jt{x)Js{z)\ 


(^) 

^ l^.(^)l 


z:^{s,z)=q 


'wis,z,q) Y 


z:'tp{s,z)=q 


x:il)(t,x)=y 


/t|s(^l^) 

\Mx)\ ’ 


( 21 ) 


where the weights are dehned in (20). 

Further applying the definition of copula density (0 and equation ( [^ , 
we get 
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fY 


^{s) 


1 -1 


iu), 




1 -1 


(?;) 




^p(s) 


F\ . 

ip{s) 


1 -1 


fY 

'‘Pit) 


(«)j/, 

f^Az^x 


^ pit) 


1 -1 


{v. 


^ \Js{z)Jt{x)\ 

X- '‘Pit,x)= [pA)\ 


z:^{s,z)=A^(^A 


fAiz)fA{x) 

^ \Jsiz)Jt{x)\ 

x--'Pit,x)=[K(t)] 

^■■i’i‘^,^)=[K(s)] 


( 22 ) 


After applying equation (11) again to get c^^ [fA{z), FA{x)) from the tran¬ 
sition of X, equation ([^) is easily reorganized into equation (19). 


□ 


5 Modeling with copulae and transformations: some 
explicit expressions 

Diffusion models are often defined by assigning a specific marginal distri¬ 
bution and fixing the remaining degrees of freedom through different ap¬ 
proaches (cf. Section for a detailed list of references). For instance, the 
authors of [7] fix the autocovariance function in order to control the serial 
dependence of the process. In miEii a specific marginal distribution (heavy 
tailed or multimodal) is assigned by transforming the tractable stationary 
Ornstein-Uhlenbeck process via suitable STTs. The novel results provided 
in Section]^ make such approach more general and systematic. In this frame¬ 
work, the design of a diffusion model requires two steps: the choice of the 
copula of a diffusion process X (regardless of its marginals) and the selection 
of the marginals. The choice of the copula is performed in accordance with 
the serial dependence of the phenomenon of interest among the copulae of 
tractable diffusions. The selection of new marginal distributions is also per¬ 
formed in accordance with the phenomenon to be modeled. Any continuous 
marginal distribution Ff (x) can be imposed by applying the transformation 
Zt = \F^^^ [FA{Xt)), without altering the copula of the process. 

Whenever the transition pdf of X is explicitly known, it is possible to 
simulate sample paths of Z exactly by transforming those of X. Further¬ 
more, it becomes possible to estimate the parameters of Z by maximum 
likelihood. 

In the next Subsections we present some examples of diffusion processes 
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whose copula can be computed. We follow the classification by Kozlov 
based on the dimensionality of the symmetry algebra of the corresponding 
SDE. Such dimensionality is preserved by STTs and allows to group the 
most tractable diffusion models in two classes. The first class comprises 
those processes whose SDKs admit a 3-dimensional symmetry algebra. All 
such processes (cf. |29j ) can be transformed into Brownian motions with 
or without boundary conditions. In Section 5.1 we present some models 
belonging to this class and derive the corresponding copula densities. The 
second class contains SDE models whose symmetry algebra is 2-dimensional. 
They can be transformed into the CIR process with suitable boundary con¬ 
ditions. Section 5^ introduces the copula of the CIR process and a few 
related models. SDEs with 1- or 0-dimensional symmetry algebra are usu¬ 
ally handled by numerical methods or by simulations and are not considered 
in the present paper. 


5.1 Brownian Motion and related processes 

The Brownian motion or Wiener process is a regular diffusion on the inter¬ 
val (— 00 , 00 ) with natural boundaries. Following equation 0 its copula 
density is 


Ct\s{v\u) 


Vi 

Vt — s 


V 


(23) 


which can be immediately recognized as a special instance of the Gaussian 
copula density (cf. [S])- A necessary and sufficient condition for a process 
which solves the SDE Q to be transformable into a Wiener process (and 
hence to admit a 3-dimensional symmetry algebra) is that its drift and 
diffusion coefficients /i(-, •) and cr(-, •) satisfy the relation (cf. [38l fTTl [29] 1 


_ ax{x,t) 
a{x,t) 2 


crt{x,t) 
cj2(x, t) 


dx -|- ci(t) 


dx 

a{x, t) 


+ C2{t) 


where ci(t) and C 2 (t) are arbitrary functions of the time variable. If this 
condition is met, the STT (16) that realizes such mapping is 


(p{t) = [ e 
Jti 

V’(t,x) = VV{t) [ + [ C2{s)VV{s)ds 

J xf) ^{y Jt2 


where xq, to, ti, t 2 are arbitrary constants. 


14 















5.1.1 Brownian motion with drift and geometric Brownian mo¬ 
tion 

Brownian motion with drift Wt = + aBt and Geometric Brownian motion 

Yt = e'^* = both result from purely spatial monotone transforma¬ 

tions of a Brownian motion Bt. Hence, they both share the same Gaussian 
copula density as the Brownian motion. Importantly, this implies that the 
copula density does not depend on the drift and diffusion parameters /r and 
a. 

Let us mention that while the transformation that maps Bt into Wt 
preserves the diffusion interval, the diffusion interval of Yt becomes (0,oo). 
Still, the nature of the boundaries according to Feller’s classification re¬ 
mains unchanged (both boundaries are natural) since the transformation is 
monotone. 


5.1.2 Ornstein-Uhlenbeck 

The Ornstein-Uhlenbeck process Xt solves the SDE 

dXt = {—aXt + I3)dt + adBt, (24) 


where Bt is a standard Brownian motion and a, /? G M. The diffusion 
interval is (— 00 , 00 ) and both boundaries are natural. The process has a 
Gaussian transition pdf and also admits a Gaussian stationary distribution 
with mean and variance ^ if a > 0. The coefficients of the copula 


process associated to Xt can be derived from Eq. ([T^. Equivalently, since 

g2Q,t_l 


a monotone STT (16) with (f(t) = 
into a Brownian motion, the copula density is easily derived from Theorem 


> V’(L x) = ^{x-^ maps Xt 


4.1 According to (18) it reads 







(25) 


The same expression can also can be derived by directly plugging the tran¬ 
sition pdf and the quantile function into equation ©• 


Remark 5.1. If we determine the copula applying Theorem 4.2 instead of 
equation 0 we immediately note that the copula density does not depend 
on the parameters fd and a and that it depends on a only through the 
time transformation. The role of the parameter a can be interpreted as 
follows: for any given time t, the Gaussian copula Co,t(tt,u) of the Ornstein 
Uhlenbeck process is close to the independent copula when a is very large 
and close to the copula of perfect positive dependence (also called the upper 
Frechet bound) when a is small. Parameter a encodes how short is the time 
range of the dependence, or the “memory” of the process. 
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5.1.3 Reflected Brownian motion 


Applying the purely spatial transformation Rt = \Bt\ to a Brownian motion 
one gets the so-called reflected Brownian motion. The transformation maps 
both boundaries of the Brownian motion to -|-oo, which remains a natural 
boundary. A lower regular boundary appears at 0. The transition pdf 
solves the heat equation with a reflecting boundary condition in 0. Since 


the transformation is piecewise monotone, we can apply Theorem 4.2 to get 
the copula density 




2y/t — S 


\/t—s 


+ 


y/t—s 


(26) 


which is a mixture of Gaussian copulae. 


5.1.4 A special case of the CIR process 

The process with SDE 


dXt — {—cxXt H —^dBt 


(27) 


represents a special instance of the more general CIR process discussed in 


Section 5.2 below. The diffusion interval of Xt is (0, -|-oo), where 0 and -|-cx) 
are a regular and a natural boundary, respectively (cf. [H]). In such a case 
the non-monotone STT (16) given by (p{t) = and ip{t,x) = 


maps a Brownian motion Bt into the solution Xt of (27). The process can 


be equivalently obtained by applying the same transformation to a reflected 
Brownian motion Rt = \Bt\ on the restricted domain (0, 00 ), where the 
transformation becomes monotone. Using the latter approach, we obtain 
the copula density of Xt by a time transformation of the copula density of 


the reflected Brownian motion (26) 


which is once again a mixture of Gaussian copulae. 


5.2 The CIR model and related processes 

The CIR process is the solution {Xt}t>to SDE 

dXt = i-aXt + ^)dt + a^/Xt dBt (28) 

on / = (0, 00 ) with /3 > 0 and Bt a standard Brownian motion. Let us 
denote by xq the initial condition at t = 0. In the literature the CIR model 
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is also named Feller process or linear drift, linear variance process. If a > 0, 

the process admits a stationary gamma distribution. The lower boundary 

in 0 is a singular point whose nature has been studied in (TB]. If /3 > ^ 

2 

the process never reaches zero (entrance boundary), while if 0 < P < ^ 
the process can reach zero and in order to solve the Kolmogorov equations 
a boundary condition needs to be imposed (we choose reflection). In both 
cases (cf. [131H] ) the transition pdf reads 

/tfi^(a:2|a:i) = cts (^ct-sX2-, , (29) 


where Cr ■= 

m) 


40 


(T 2 (l-e-“(’’)) 


and fy 2 0 is the non central chi-square density (cf. 


f^2{z;iy,X) :=^e . 

Here Ia{-) is the modified Bessel function of the first kind, defined by 


laiz) := ^ 


2 : \ 2 m+a 




—^ m! r(m + a -|- 1) \2J 

m =0 V ' ' / 

Stable numerical algorithms that avoid direct evaluation of the Bessel func¬ 


tion are available to evaluate the pdf (29). The corresponding distribution 


function Fj*^®(x 2 |xi) and its quantiles are also easily computable. A ready- 
to-use implementation is available in R, cf. m- A direct substitution into 


equation ( 11 ) provides a computable formula for the copula density of the 


CIR process: 




Ct-sf^2 7, 7,0)^ 

q/x 2 7, cte-“*xo 


(30) 


2 a 


where 7 := ^, := 

However, as we prove in Remarks 5.2 and 5.3 below, such a method of 


71 - 6 -“’’)' 


and xq is the initial condition at t = 0 . 


calculation would hide much information about the effective dependence of 
the copula density on the parameters of the process. 

Remark 5.2. Despite the dependence of the transition pdf (^sla^i), the 
marginal distribution Ft{x) and of the quantile function Ff^{p) of the CIR 
process on the three parameters a, /3, and cr, the copula density effectively 
depends on two of them only, namely a and 7 = ^. A rigorous proof of 
the previous statement will be given in Remark 5.3 An interpretation of 


the role of the two parameters is given as follows. Parameter a retains the 
same role it has in the Ornstein-Uhlenbeck process, i.e. it is related with 
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the range of the dependence of the process (the larger a, the shorter the 
memory). Parameter 7 = ^ measures the ratio between the drift and the 
noise. If 7 < 2 the noise is strong enough to drive the process to 0, which is 
a reflecting barrier in our setting. If 7 = 1, in particular, then the process 
can be obtained from a reflected Brownian motion by a monotone STT (see 
Section 5.1.4) and hence its copula is a mixture of Gaussian copulae. On 
the other hand, if 7 < 2 the drift prevails and the process does not reach 
the lower barrier. 


5.2.1 Rayleigh Process 

Any diffusion process Q can be transformed into one with a constant unit 
diffusion coefficient through the STT 




dx 

a{x)' 


Such STT for the CIR process Xt of equation (28) becomes 


Yt = 




a 


(31) 


and one gets the Rayleigh process T). Note that a in (31) is not any more 


the diffusion coefficient of a general diffusion as in the previous formula, but 


a parameter of equation (28). The transformation is monotone and keeps 


the boundary points 0 and +00 and their nature. The diffusion process 1) 
solves the SDE 


dYt={- + bYt 


dt + dBt 


(32) 


with a = ^ 6 = — ^, and Bt a standard Brownian motion. The copula 

density of T) is therefore identical to that of a CIR process. 


Remark 5.3. It is now easy to prove the statement in Remark 5.2 that the 
copula of the CIR process depends only on the two parameters a and 7 . It 
immediately follows by the fact that it has to be the same copula as that of 


the Rayleigh process obtained by transformation (31), whose two parameters 


a and b are indeed one to one functions of the original parameters a and 7 . 


5.2.2 Bessel Process 

Bessel processes of dimension 5 + 1 are diffusions whose paths solve 

dZt = —dt + dBt- 
Zt 

with 5 > 0 and Bt a standard Brownian motion. When 5 is a non-negative 
integer, Zt has the same law as the euclidean norm of a (5 + l)-dimensional 
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Brownian motion. The monotone transformations (16) 


Lpit) = 


1 — e 


-2bt 


2b 


x) = xe 


-bt 


( 33 ) 


map a Rayleigh diffusion (32) into a Bessel process with parameter S = a. 


The diffusion interval remains (0, oo) and the nature of the boundaries is 


process with 6 = 
change 


preserved. Using (31) and (33) we directly map a CIR process into a Bessel 


-1 


and hence the two copulae only differ for the time 






.BES 


{u,v) 


where the function (/?(•) is given in equation (33). 


5.3 Comparison of different copula densities 


In Section |5.1| and |5.2| we have introduced different copulae of diffusion 
processes. Apart from time changes, these copulae can be classified into 
three groups: Gaussian copulae (Brownian motion with or without drift, 
geometric brownian motion and Orstein-Uhlenbeck process), mixtures of 
Gaussian copulae (Reflected Brownian motion and the special case of the 
CIR process) and CIR-related copulae (CIR process in the general case, 
Rayleigh and Bessel processes). In Figurewe present a visual comparison 
of the three copula densities. 

The underlying Ornstein-Uhlenbeck and CIR processes (also in the case 
when the CIR is a time-changed Brownian motion) are scaled to a common 


time scale through a suitable choice of the parameters of their SDEs (24), 


(27), and (28). The scale of the dependence is established by the magni¬ 


tude of the mean reverting parameter a, which is kept fixed at a = 0 . 1 . 
Other parameters common to all processes are s = 30 (stationary regimes), 
t = 30.5, xq = 10. The Gaussian copula density (25) is plotted in the up¬ 
per left corner. It is symmetric in the arguments and more concentrated 
around the diagonal. Two spikes are visible at (0,0) and (1,1). The CIR 
copula is plotted at three different values of the parameter 7 in the other 
panels of the Figure. For very large 7 , the noise is very small with respect 
to the drift, and the CIR copula closely resembles the Gaussian one. In this 
regime the probability that the process approaches values close to 0 is so 
small that the effect of the barrier at 0 is negligible. In particular, the upper 
right corner of the Figure shows the CIR copula density corresponding to 
7 = 625. The smaller is 7 , the larger is the noise compared to the drift. 
For 7 = 6.35 the copula becomes asymmetric, with a peak at (1,1) and a 
flat region around (0,0). Flat regions in the copula density correspond to 
regions of independence (note that the independent copula C{u,v) = uv 
has a flat density c{u,v) = I, cf. [Mj)- In such regions the noise is strong 
enough compared to the drift to spread consecutive observations quickly. 
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OU copula density 


CIR copula density, y = 625 



CIR copula density, y = 6.25 


CIR copula density, y = 1 




0 


0 


Figure 1: Comparison of copula densities. 


so that they appear almost independent. Indeed the stronger the noise is, 
the weaker is the dependence between small observations. Conversely, be¬ 
cause the drift of the CIR process grows linearly with the value taken by the 
process while the noise grows only sublinearly, the dependence among large 
values remains strong. Therefore, large values of the process are more per¬ 
sistent than small values, especially in the presence of a strong noise. The 
lower panels of the figure show the copula density for 7 = 6.25 and 7 = 1 . 
The latter corresponds to the case when the CIR process is a time-changed 
reflected Brownian motion. As apparent from the analysis of Figure the 
three copula densities that we analyzed have different shapes which mark 
different properties of the associated dependence structures. The informa¬ 
tion a copula density conveys should be taken into account when modelling 
natural phenomena via diffusion processes. 
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5.4 Application to neuronal modeling 


Ornstein-Uhlenbeck and CIR processes find extensive applications in neuro¬ 
science (cf. |39l 03] ), where they are used to model the temporal evolution of 
neuronal membrane potentials. Neural cells in the cortex communicate via 
fast discharges of electrical impulses called action potentials, or “spikes”. 
Spikes arriving to a cell from input (“pre-synaptic”) neurons change the 
electrical membrane potential of the receiving cell by altering the difference 
between extra- and intra-cellular concentration of ions. In the integrate-and- 
fire model whenever the membrane potential hits a critical upper threshold 
-called firing threshold- a spike is generated and sent to receiving (“post- 
synaptic”) cells. Immediately after spike generation, the membrane poten¬ 
tial is reset to a lower reset value. If a cell receives weak inputs from a 
large number of cells the sub-threshold evolution of its membrane potential 
until spike generation can be effectively modeled via continuous diffusions 
such as the Ornstein-Uhlenbeck and CIR (usually named Feller in the held) 
processes. If so, the spike times of the cell are hrst-passage times through 
the bring threshold. 

A comparison of the Ornstein-Uhlenbeck and Feller models based on the 
distribution of the interspike intervals has been carried out in [3T]. The 
lower-bounded Feller model is often considered more realistic because com¬ 
patible with the fact that neuronal membrane potentials cannot become ar¬ 
bitrarily negative. Such a consideration however only supports the marginal 
distribution of the Feller process compared to the Ornstein-Uhlenbeck one, 
and does not relate to the serial dependencies imposed by the two processes. 
The two processes are known to share the same autocovariance structure, 
which indeed only depends on the drift of the SDE. Realistic ranges for 
the parameters of the two diffusion process can be obtained by statistical 
estimation from experimental data of intracellular recordings, as done in 
HEHSI and by theoretical reasoning (cf. [HI]). In the case of the Ornstein- 
Uhlenbeck model (24) the only parameter relevant to the copula is a, which 
following the references above we take to be 0.1 (see Figure upper-left). 
In the case of the CIR process we also set a = 0.1, while realistic values for 
7 range from 20 to 2500 (7 = 625 in Figure]^ upper-right). As shown in 
Figure in this parameter region the two copula densities are very similar. 
In light of these preliminary results, we suggest a new diffusion model for 
the temporal evolution of neuronal membrane potentials by combining the 
simpler copula of an Ornstein-Uhlenbeck process with the more realistic non 
central chi-square marginals of the CIR process. 
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